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The project discussed here was an outgrowth of a 
Title I9 Elementary Seconoary Education Act cooperative project 
involvi^ng nine Arkansas school districts, • Initiated during ,1371-72 
school year, the cooperative's first two years focused on developing 
and fiel'aT testing proced'ures. f or conducting district wide assessment 
of needs, program planning, and program evaluation. Daring the 
1973-7W school year, these procedures were applied. That year's 
results served as a basis for further development and refinement 
during 197^-75. The purpose of this report is to describe the project 
activities implemented during 1974--75 and to present the evaluation 
results. The project utilized the Continuous Assessment Reading 
Design (CARD) , a criterion-* referenced assessment instructional 
program.* The assessment component is designed to measure the specific 
skill needs of pupils, who have demonstrated an ability to perform at 
instructional levels kindergarten through six in the reading 
materials or basal series currently in use in their school district. 
The tests provide teachers with immediate and^ specific information 
about the pupils' reading skill strengths and weaknesses. Since each*, 
test item is keyed to a performance objective, the items missed by a 
pupil yield a profile of skill needs in the form of performance 
objectives. ( Author/ J.H) . 
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I. INTRODUCTION . * . • 

.This project was an outgrowth of a Title I, ESEA cooperative project 
involving nine Arkansas school districts. The cooperative was initiated 
duri;rg the 1971-72 school year in response to the need for establishing 
accountability procedures in Title I, -ESEA programs. During the first two 
years, the emphasis was focused on developing and fi^ld testing procedures 
for conducting districtwide assessment of n^eds, program planning, and 
program e^V'aluation. At the end of the two-year period, the step-by-step 
procedures which had proven effective and practical were published by the 
Arkansas State Department of Education. This publication entitled, 
A Project Guide for Implementing an Accountability Management System (AfIS) / 
in Title I, ESEA andt Other Programs , was disseminated to all districts in 
the state and has resulted in improved Title I projects and evaluation 
reports . 

After accomplishing the established goal of developing and field testr 
- 'ing p^i^ogram accountability procedures, the participating districts directed 
their efforts to the appljcati^n-of accountability procedures in Title I, 
ESEA reading programs. This effort was initiated during the 1973-74 school 
year. The results achieved during the 1973-74 school year served as a 
basis for fyrther development and refinement during 1974-75. Those 
districts participating included Helena-West Heler\a, Brinkley, Delta Special, 
Fort Smith, Hope, Marianna, Montipel lo. Mountain Home, and Russellville. 

The Helena-West Helena School District, served as the administerfng 
agent for the cooperative. The districts were assisted by the staff -of 
Educators Cons'ultiilg Services, Inc., who had been involved in the coopera- 
tive project since its inception. 
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^ The purpose of thisVeport is to describe the project activities 
implemented during 1974-75 and to present the evaluation results. 

II./ PROJECT PARTICIPANTS ' ^ * 

A.; Target Students 

Each of the participating teachers selected one section .of their 



Title I participating students who were being provided instruction in 
reading^to serve as the target population. A summary of the number of 
minority and nonminority target students by grade is presented in Table I, 

TABLE I ^ 

THE 'number of MINORITY AND NONMINORITY STUDENTS PARTICIPATiSg IN THE \ 
1974-75 TITLE I, ESEA COOPERATIVE READING PROJECT BY GRADE 



GRADE 


TOTAL 
NUMBER 


NUMBER -OF 
MINORITY 


NUMBER OF 
NONMINORITY 


1 


149 


107 


42 


2 


128 


80 


48 

94 / 


3 


160 


66' 


4 


' 130 ' 


102 / 


28 


5 


•74 


44 j 


30 


6 


41 


23 


18 


TOTAL 


682 


422 


260 



These participating Titl6 \ students were those who had demon- 
^. strated deficiencies in reading achievement as measured by stan- 
dardized reading achievement tests. The most common criterion applied 
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by the nine distripts in selecting the students Was that their 
deficit in reading was one or more grade level equivalent scores 
below grade placement. In some of the districts, recommendations 
by their previous teacher were also used^as a second criterion 
for selection, * ■ * 

Teachers 

Each of tlie nine participating districts selected teachers to 
participate in the 1974-75 project. The number of teachers by 
district was as follows: V'^^ ^ 

District 



Helena-West Helena 
Brinkley 
Delta Special 
Fort Smith 
Hope 
4 Ma ri anna 
Monticello 
Mountain Home • 
Russell ville 



No. of Teachers 

12 
4 
2 
5 

3 
2 
4 

• 46 



Thes|b teachers were provided training in implementing ]rtie diai|4l 
nostic jfeading procedures within their target classrooms./ They, 
adminisiereci criterion-referenced reading tests and «eco/ded all 
evaluative data specified in the evalua^tion design. Sbpe of the 
teachers were assisted by aidls, while others were not/ 
Superintendents and Coordinators of Federal: Programs 

The superintendents and/or coordinators of Title /I, ESEA Programs 
in each district served as the cooperative board. Tttey provided 
assistance in implementing the program within their respective dis- 
tricts and maintained communication with the administering district 
and the State Department of Education. 

,8 



D. Printipals and Instructional Supervisors 

The principals of the schools where target classes were located 

and the district's supervisors provided supportive assistance to the 

project activities. They attended training sessions, helped monitor 

the target classrooms, conducted the group meetings within their 

districts, and gave assistance to teachers as needs were identified, 

■ E. State Department of Education Staff 

The coordinator of Title I, ESEA and his supervisory staff assisted 

in the development and implementation Of the project activ^ities. 

Their activitiW included assisting the cooperative board with the 

^ management of the project, attended the training sessions, conducted 

on-site visits to the participating districts, and maintained contact 

with USOE to communicate the progress of the project activities, 

F. Outside Consultants 
*. ■ ■ ' ■ ■ ■■ 

Ttie staff of Educators Consulting Services, Inc., of Conway, 
Arkansas, provided support in th^ developmejit of £he readia^ design, 
conducted the staff development activities, provided criterion test 
and training materials, conducted on-site monitoring visits to each 
project classroom', analyzed all evaluative data, and completed this , ^ 
evaluation report. 

IIK PROJECT OBJECTIVES 
A. Objective One 

By May 30, 1975, eighty percent of the target students will demon- 
strate achievement gains in reading as indicated by the following: 
. An equivalent to one grade level in the basal reading series as 
measured by pre- and post-administration of the following measures: 
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vocabulary gains made in basal series and^pre/post-gains made on 
the Criterion-Referenced Reading Test. ^ 
One month's mean gain for each month of participation as measured 
by pre/post-standardized achievement tests. 
Objective Two 

By May 30, 1975, the participating LEA's, with tf^e assistance of 
the consultants, will hjive demonstrated effective ongoing program 
evaluation by applying the AfIS model.. Evidence that this objective 
has been achieved will include: 

. The number and percentage of the target students placed and main- 
tained at their proper instf'uctional level. 

. The degree of accuracy which each teacher systematically records 
each target student's reading errors ancf implements appropriate 
instructional activities. 

. Completed pupil record sheets, pupil contracts, and individual 
records of progress maintained by the teachers and verified by 

the supervisors, principals, and consultants. 

, ^^^^ , 

Objective Three ^' , . ^'-^ - 

At the end of each month, the supervisors and principals will . 
have demonstrated effective supervision and monitoring procedures 
in the Title I,^ESEA AMS project by: 

. Conducting a minimum of one classroom vis^it per month to each target 
classroom and recording the degree of accuracy of placing each 
target student at his proper instructional level and recording, 
systematically, the reading errors generated by the target students. 

10 



♦ Conducting a minimum of one group meeting per month with the 
particij^ting teachers to identify and discuss problems being 

' encountered and alternative procedures to be employed, r 

\ 

Evidence that this objective is being satisfactorily achieved will ' 
be completed monitoring reportfs submitted to the project consultants 
who will ll^ovide written recommendations for any problems presented* 
Objective Four 

By May 30, 1975, ninety percept of the forty-si.x elementary 
reading teachers who participate in the AMS Title I, ESEA coopera- 
tive Voject will have applied the, AMS model to a reading , program 
involving fifteen to thirty target students. Evidence that this 
objective has been accomplished will be indicated by eighty percent 

^ \ : 

level of accuracy fn: 

\^ 

. Placing each target student at his\ proper instructional level, 

♦ Recording, systematically, the reaching errors, 
. Matching the errors generated with the appropriate performance 

objective^. 

♦ Completing weekly pupil contracts,. 
.''Performing continuous diagnosis. \ 
Objective Five ^ ^ 

After participating in the AMS Title I, ESEA cooperative project,' 
the forty-six elementary teachers and th^ir immediate supervisors 
will respond positively to the AMS model being applied in the classroom 
as measured by a semantic differential instrument constructed by the' 
project consultants* The expected level of positive response will be 
a m^tLof at least 3,5 on a five-point scalk 
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IV. DESCRIPTION OF DESIGN ^ • - ^ _ 

The Continuous Assessment* Reading Design (CARD), previou^y referred 
to as the AMS Reading Design, is a criterion-referenced assessment ^ 
instructional program. The assessment component is 'designed to measure • 
the specific skill needs of pupils who have demonstrated an ability to 
perform at i nstructional, levels kindergarten through six in the reading 
mateVial^s or basaT series currently in use in their school district. 
The tests will provide classroom teachers with immediate and specific 
information about the pupils^ reading skill strengths and v/eaknesses. 
Since each test item is keyed to a performance objective, the items^issed 
by a pupil will yield a profile of skill needs in the form of performance 
objectives. These objedtives will guide the teacher's instruction as the 
pupil progresses througti the reading materials. 

The CARD assessment progratn is based on the concept of INSTRUCTIO[>IAL 
LEVEL. Instructional levels take into consideration the three major areas 
of reading behavior that are amenable to measurement: word recognition , 
comprehension , and fluency . Most classroom teachers are familiar with the 
concept of instructional lev^l. Defined in operational term's, instructional 
level means the level at which a pupil demonstrates 92 to 96 percent word 
recognition mastery, at least 60 percent mastery in comprehension ,-^ and 
fluency which meets the minimum rate for the particular- level . 

s 

The purpose of the Continuous Assessment Reading Design (CARD) is to 
provide teachers^ with a continuous assessment of pupils* reading skill 
strengths and deficiencies. This type of assessment generates diag^nostic 
information needed by teachers on a routine^ basis. Unlike other typical 
assessment measures that are administered on a once-or-twice-a-year basis. 
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"CARD is administered any time a pupil pro5resses from^one Instructional 
» . 7 12 ■ 



» 

\ 

levyfel to another, or whenever the teacheijT deems it necessary. The CARD 
program is an integral part of the total instructional program. 

In the development of the CARD ^^sessment program, it was considered 
to be of utmost importance to matdh,^fthe assessment design to a coherent 
instructional design. Illustrated in Figure 1 is the CARD instructional 
design^. 
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• FIGURE 1 
INSTRUCTIONAL 



DESIGN 



STEP 1 



Determine instructional 
levels of pupils in each 
subject area and start 
irrstruction at this point 



STEP 2 



Record errors made by 
pupil at instructional 
level 



STEP 3 



Match pupil errors to 
performance objectives 
and complete weekly contracts 
for pupils 



STEP 4 



Teach the identified skill 
need or concept to pupil 

using performance objectives 
as basis for instruction 



STEP 5 

Assign pupil to instructional 
material for 
independent skill 
practice 



STEP 6 



*Pupil works on assigned 
material with periodic 
teacher and/or aide 
monitoring 



. STEP 7 

Place pupil in instructional 
level material to determine 
if skill development 
has occigrred 



-> If not 



Return to Step 4 



If it has 
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Move pupil ahead 
in materials until 
.he generates the 
number of errors 
required for 
Instructional ^ 
level placement 



* Using the instructional design illustrated in Figure 1 as a model, / 
an assessment design was formulated. This assessment design, illustrated 
in Figure 2, reflects the similarities between the two. 



FIGURE 2 
CARD ASSESSMENT DESIGN 



Determine 
Pre-reading 
or 
Readi ng 
' Instructional 
Levels 



Identify 
Specific 
Skill Needs at 
I nstructional 
Level 
(Pretest - Form A) 



Match 
Skill Needs 
to 

Performance 
Objectives 









■ \ 


Teach 
to 

Performance 
Objectives 




Determi ne 
• Mastery of 
Performance 
Objectives 
(Posttest - Form B) 




Repeat 
I ns tru cti ona 1 
Cycle at Next 
Assessment 
Level 
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In blending the assessment and instructional designs together, common 
elements of classroom management emerge. The common elements are as 
follows: 

X. Diagnosis and placement of pupils at their proper instructional levels, 

2. Matching pupil. skill deficiencies to performance objectives as weekly 
pupil contracts are completed. ' ^ ' 

3. Conducting direct teaching activities with pupils having common skill 
deficiencies. 

4. Assigning pupils to instructional material for independent skill 
practice., 

5. Determining pupils' skill mastery of performance objectives by perform- 
ing a continuous diagnosis. ^ 

15 
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6, Repeating instructional cycle at next assessment level • 
These six steps implemented by teachers on a systematic basis/are the 
essential ingredients of the Continuous Assessment Reading Design, tpARD), 



V. PROCEDURES EMPLOYED 

A. Activity One — Staff Development Activities 

Six days of staff development activities were condiic ted/for the 
participating teachers^ principals, and supervisors. JThese sessions 
were held ^^^ttle Rock on the follov/ing dates: September 19, 20, 
1974; r^veiT?|y^'\9, 20, 1974; February 26/2?^ 1975. 



The training topics included in the sessions were: 
Overview of elementary reading instruction. 
Placement of pupils at the proper level of instruct/i( 



Practicum in determining instructional levels and recording pupil 
errors (this involves working with pupils to incr^s^ the teacher's 
proficiency). _ / / 

Identifying and developing instructional materfa,ls ^nd exercises 
coded to the specific support systems. 



Conducting direct teaching activities with pu^ls having common 
skill deficiencies. ^ / 

Assigning pupils to instructibnal material far independent skill 
practice. ' / 

Determining pupils' skill mastery of perfori^ance objectives by 
performing a continuous diagnosis. / 

Repeating the instructional cycle at the next assessment level. 

Overview of CARD tests. 

How to administer the CARD test^ ' . 



Administering the CARD tests to^pupiU as a practicum exercise. 
Procedure's for sendirig test data from tiie classroom to the consultants 
Storing and retrieving CARD test information. / 
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Plan for implementing the CARD assessment design at each local 
school district level. 

A review of diagnosis and placement. 

Matching pupil skfH deficiencies to performance objectives. 

Constructing "weekly pupil contracts as a guide to working on 
skill deficiencies. 

These steps implemented by teachers on a 'systernatic basis are the 

essential ingredients of the Continuous Assessment Reading Design 

♦ 

(CARD). After each training session was completed, ongoing classroom 
monitoring and informal local training sessions were continued to 
assist the teachers in the continuous development of their skills as 
the design was implemented. 
Activity Two ~ Selection of Tajpet Students 



Each of the teachers se/Iected .o^e garget class of Title I, ESEA 



students scheduled to be provided reading instruction. This target * 
class served as the focal point for jmplementfng and evaluating the 
reading design.' In most instances, the teachers applied the design 
to other groups; hov/ever, the project monitoring and evaluation was 

A 

limited to these students. i 
Activity Three Evaluation Design Completed. 

The consultants completed an evaluation design to be applied in 
determining the level of effectiveness of the implemented design. 
(See copy. Attachment A.) 

Activity Four — Monitoring by Consultants and State Department of 
Education^ Title I> ESEA, Supervisors 

The Title I supervisors conducted a minimum, of one on-site visit 

to each participating district during the school year. The consultants 

made two on-site visits to each teacher^s classroom to. assist in 
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monitoring the progress of the project and to help v/ith problems 
beii^ig encountered^ Monitoring reports were completed by the^h- 
su]tants and. distribut-ed to the coordinators and/or sUp^intendents, 
'th,e__ddministering 'district, and the State Deg^tr^nt of EducationJ 



Activity Five — Monitoring and Supporfive Assistance by Local 



Supervisors and Principals 

The local instructional supervisors in those districts jiavir|^g 
^uch persons and the principals of the schools where the target/ 
groups were located served a key role in monitoring the progress of 
the prpgram and assisting each teacher in mastering the skijlls neces- ^ 
sary to implement the ciesign. The level of assistance varifed from 
one district to anotifter in direct proportion to the supervtsprs' pnd 
principals' .involvement in the training activities. These jiersons 
conducted classroom visits and group sessions .and helped collect and 

. ' ] ^ ^ ;\ ] 

develop instructional materials to be coded for the support system, 
: * . - • ' I ' 

(See list of skiUs included in t,he support system, Attacf^'m^nt B,) 

Activity Six ^oi^ection<_of EvMuation Data 

Each d^'VtriCt co^lect^ evaluative d^ta for both prot^Ss and 

product^valuation in^^accordance ftith the- evalua4:ion design. The 

consultants |;>rovided dl^ta forms and instruction during t|e training 

sessions and on-site visits^. (See copies of data forms /'Attachment C.) 



Actiyityu Seven — Analysis of Evaluative Data and Completi-jem of 
End-of-Year Report ; < 

i "' 

The consultants tabulated and analyzed all evaluaftive data and 
Included it in this evaluation report. /* ; * 



VI. EVALUATION RESULTS . — ^ ' . ' 

A. Objective One 

By May 30, 1975, eighty percent of the target students will demonstrate 
achievement gains in reading as indicated i)y the following: 

Nsl. An equivalent td one grade level in the basal reading series as 
measured by pre- and post-administration of the following measures: 
Xvocabulary gains made in basal series, and 
. pne/post-gains made on the Criterion-Referenced Reading Test. 

2. One monur*? mean gain for each month of participation as measured 
by pre/post-standardized achievement tests. 

Since the Criterion-Referenced Reading Test used ini this program 

is administered at the slHJdent!^ instructional level, the extent that 

part one of t^is objective was^axhieved was determined by analyzing 

*the pre/post-gatns on the Criterion Test. 

''The„dbjei:tive stated that eighty percent of the target students 

would demonstrate achievement gaiins equivalent to one grade level in 

the basal reading series as measured by the Continuous Assessment 

Reading Design (CARD). The CARD. tests are designed to measure tHe 

'Specific skill needs of pupils who have. demonstrated an ability to , 

perfonn at instructional levels kindergarten through six in the reading 

' r / • 

materials or basal series currently in use in their school district. 
The tests provide the teacher with immediate and specific information 
about pupils* reading skill strengths and weaknesses. Since each test 
is keyed to a performance objective, the items massed by a pupil will 
yield a^ profile of skill needs in the form of performance objectives. 

The CARD assessment program (unlike other criterion-referenced 
measures) is based on the concept of INSTRUCTIONAL LEVEL. Instruc- • 
tional levels take into consideration the three major areas of reading 
behavior that are amenable to measurement: word recognition . 



ERIC 



19 

14 



comp?reHension > and fluency. Most classroom teachers are familiar 
with the concept of instructional level. Defined in operational 
terms, instructional level means the level at which a pupil demon- 
strates 92 to 96. percent wocd recognition mastery, at least 60 
percent mastery in comprehension , and fluency which meets the 
minimum rate for the particular level. 

In the Title I pilot reading prpgram, 505 students were 
administered the CARD pretests in September and October of 1974. 
In April and May of 1975, 463 students were posttested. The number 
of students by grade level taking each test is presented in Table II 
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At grade one , 83 students were reading instructionally at PP^, 

PP2, or PP3 when thfe pretest was administered in September and 

October of 1974. -:,In April and May of 1975, 84 students were post- 
s' 

tested; 22 were re^ng instructionally at PPi, PP^, or PP3, 58 were 
reading instructiqpally at level 1^ and 1^, .and 4 students were 
reading ins true tionat1#,.at le\A^l 2\ and 2^. Seventy- four of the 
first grade students raet or exceeded the stated objective. 

A total of 125 second_grade' students was pretested. Of th? 125 
students pretested, 102 (82%) were reading instructionally at PP^, 
PP2, or PP3; these pupils were reading approximately one grade ^ 

"v 

level below actual grade placement. Twenty-one (17%)_were reading 
at leveTl^ and two {2%) were reading at level 2^. When the posttests 
were administered to 123 students in April and May of 1975, 13 (11%) 
second graders were reading at PP^, PP^, or PP3; 64.(52%) were 
reading at level 1^; 42 (34%) were readfng at level 22; and 4 (3%) 
were reading at level 3^. Eighty-nine percent of the second graders 
met or exceeded the objective. ' 

A total of 141 third grade students was pretested. Of the 141 
students pretested,'41 (29%) ,were reading instructionally at PP^, PP^, 
or PP3; 55 (39%) were reading at level 1^; 27 (19.%) were reading, at 
level 21; and 18 (13%) were reading at level 3 1.^:,'. When the. posttests 
were administered to 128 third graders, 10 (8%) were reading at levels 
ppi, pp2, or PP3; 18 (.14%) were reading at level 12;.16 (13%) were 
reading at level 22; 60 (47%) were reading at level 32; and 24 (18%) 
were reading at Tevel 4^ The precise number of students meeting or 
exceeding the objective could not be determined. However, when the 
pretest was administered, 90% of the third grade students were 

'22 
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reading one or more grade levels below actual grade placement; when 
the^^ost-test was administered, 65% of the third grade students were 
reading at or above actuaV grade placement. Based on the fact that 
these students made significant gains during the school year sa that 
65% of them were reading above grade level, compared to only 10% * 
at the beginning of the school year, it is concluded that the objecti 
was achieved. 

A total of 108 fourth grade students was pretested. Of that 
total, 15 (14%) were reading at levels PP^ PP2, or pp3; 40 {37%) were 
reading at level 1^; 42 (39%) were reading at level and 11 (10%) 
were reading at level 3^. When the posttests were administered to 
96 fourth graders, 2 (2%) were reading at levels PP^ PP^, or PP3', 
32 (33%) were reading .at level^a^-, 26 (27%) were reading at level 22; 
24 (25%) were reading at^eveJ S^Tand 12 (13%) were reading at level 
42. Seventy-three (76%) of the fourth grade students met or exceeded 
the objectives. 

A total of 48 fifth grade students was pretested using the CARD 
tests. Of the 48, 2 (4%) were reading at PP^ PP^, or PP3; 9 (19%) 
were reading at level 1^; 17 (35%) were reading at level 2^; and 20 
(42%) were reading at level 3^. All students pretested were achieving 
at least two grade levels below actual placement. Twenty-eight, or 
nearly 60%, of these students were achieving three or more grade level 
below actual placement. . When the posttests were administered to 32 
fifth graders, 2 06%) were reading at level 2^; and 30 (94%) were read 
ing at level 4^. Though the sample size was small, the improvement 
in achievement was quite signif icar\t. The objective was achieved for 
fifth grade students. ^ ' 
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It is interesting ,tQ note that of the 505 students in grades 
one through five that were pretested, 243, or 48^, were reading 
instructionally at PP^ PP^, or PPh 125 (25%) were reading 
instructionally at levels l^and l2; 88 (17%) were reading at 
levels 2^ or 2^; and 49 "(10%) were reading at levels 3^ or 3^.^ 
Based on this data, the estimated mean grade equivalent achievement 
score would be 1.0 for all students at the beginning of the pro- 
gram (October, 1974). 

At the end of the Title I Pilot Reading Program (May, 1975), 
463 students enrolled in grades one through five were po'sttested 
using the CARD criterion reading tests; 47 (10%) were reading 
instructionally at PP^, PP^, and PP^; 172 (37%) were reading instruc- 
tionally at level 1^; 90 (19%) were reading instructionally at 
level 2^; 88 (19^) were reading instructionally at level 32; and 
66 (14%) were reading instructionally at level 4^ The estimated 
mean grade equivalent score f or .all students at the end of the 
program is^2.8. This is an overall gross gain of 1.8 grade equiva- 
lent score from the pretest to the posttest. 

The yearly progress of students enrolled in the CARD instructional 
program was determined by measuring their specific reading skill 
deficiencies on a continuous basis throughout the 1974-75 school 
year.* Jhe results are presented for each grade level in Tables III, 
IV, V„Vr, and VII. /- \ 



* A list of skill elements measured -for each instructional level 
is presented in Attachment D. ' 
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The following is a sunmary of CARD Test results by grade level. 



GRADE ONE 



Eighty- three (83^) students were pretested with CARD Test lA. Level lA 
corresponds to instructional levels PP^, PP^, and PP^. 

. Major Skill Deficiencies: CARD lA 







Items Hissed 


Items 


Skin 


N 


% 


5 


Phonic Application (Initial Consonant. Substitution) 


44 


53 


10 


Structural Analysis (Inflected Endings) 


54 


66 


11 


Structural Analysis (Contractions) 


41 


71 


12 


Structural Analysis (Contractions) 


46 


55 


13 


Context Analysis 


56 ■ 


68 


14 


Context Analysis - 


61 


73 


15 


Context Analysis ' i ' • 


— 58 


69 


16 


Context Analysis 


41 


49 


19 


Context Analysis 


50 


60 


20 


Context Analysis 


42 


5Q 


22 


Remembering ^ 


42 


.50 



Posttest 



Twenty-two (22) students were pqsttested with CARD Test lA (^P^, Pp2, pp3). 

Major Skill Deficiencies: CARDIA* 

Items Missed 

Items Skill _N_ _%_ 

10 Structural Analysis (Inflected Endings) . ^ 10 45 

12 Structural Analysis (Contractfons) • ,15 68 

13 • Context Analysis 18 . 82 

14 Context Analysis , ^0 90 

15 Context Analysis . .'JmZ ' 59 

16 Context Analysis - " , ^^i^t'-r 12 55 

19 Context Analysis ' 15 68- 

20 Context Analysis . > 15 68 
22' Remembering _ 15 68 

Twenty-two (26%) of the first grade students did not meet the stated 
objective of one year's grade equivalent achievement gain. These students 



erIc , . . .1 



were reading instruct! onally at PP^, PP^, and PP^ when the pretest was 
administered; and they were also reading at those levels when the post- 



tests -Were a^^istered. 



Fifty-eTghT't^^^^^ (70%) were posttested with CARD Test 

IB* Level IB corresponds to Tnstriictional levels V and 1^. / 



Major Skill Deficiencies: CARD IB ) /t) 

• Items Missed 



Items i Skill 


N 


% 


■ 7 Phonic App'li cat ion/Medial Vowel (Substitution) 


27 


47 


20 Context Analysis 


21 


36 


27 Organizing (Sequencing) 


42 


72 


28 Predicting/Extending (Convergent Outcomes) 


35 . 


60 


Four (4) first grade students (4%) were posttested with CARD Test 2. 


CARD 


Jest 2 corresponds to instructional levels 2^ and 2^. 






Major Skill Deficiencies: CARD 2 








Items Missed 


Items Skill . ' 


N 


% 


. 7 Phonic Application/Silent E (CVC-e) 


2 


50 


8 Structural Analysis (Compound Words) 


• 2 


50 


11 Structural Analysis (Comparatives) • • 


2 


50 


12 Structural Analysis (Syllabication) 


3 


75 


14 Context Analysis 


2 


50 


20 Context Analysis 


2 


50 


24 Organizing (Sequencing) 


2 


50 


26 Remembering 


2 


50 


30 Predicting/Extending (Convergent Outcomes) 


2 


50 


Seventy- four precent of all first grade students met or exceeded the 


stated 



objective of one year's grade equivalent achievement gain/ 



ERIC * 



36 

26 



GRADE m 



■ ^ . - Pretest 

On^' hundred twenty-five (125) students were pretested; 102 (82%) took 
CARD Test lA, 21 (17%) took CARD IB, and 2 (2%) took CARD Test 2. 

Major Skill Deficiencies: CARD lA 
■ (M-= 102) 

1 

I tans His.sed 

^' Items ^' ^ Skin ' ■ JL _1_ 

9 Structural Analysis (Inflected Endings) 41 40 

10 Structural Analysis (Inflected Endings) 41 40 

, 13 Context Analysis ^ " -42 41 , 

14 Context Analysis 55 54 

21 Locating Information 41 40 

, Major Skill Deficiencies: CARD IB 
.- 4iL = 21) 



4 Phonic Application/Final Consonant (Substitution) 9 43 

7 Phonic Application/Medial Vowel (Substitution) 9 43 

8 Phonic Application/Medial Vowel (Substitution) 10 . 48 
11 Structural Analysis (Inflected Endings) 10.^ 48 
25 Locating Information 9- 43 
27 Organizing (Sequencing) 18 86 

Major Skill Deficiencies: CARD 2 
(N = 2) 



7 Phonic Application/Silent E (CyC-e) 2 100 

12 Structural Analysis (Syllabication) 2 100 

24* Organizing (Sequencing) 1 50 

25 Remembering i 50 

27 Locating "t ' } 52 • ■ ^ 

28 Locating ' , 1 50 v,^ 



Posttest 



One hundred twenty-three (123) students were posttested; 13 (11%) took 
CARD Test lA, 64 (52%) took CARD Test IB, 42 (34%) took CARD. Test 2, and 
4 (3%) tofok CARD Test 3. 



ERIC 



37 

27 



Items 



Skill 



10 
12 
13 
14 



11 
20 
27 
28- 



•12 
25 
29 
30 



14 
20 
23 
24 
26 
27 
28 
29 



Major Skill Deficiencies: CARD lA 
(N = 13)' 

Structural Analysis (Inflected Endings) 
Structural Analysis (Contractions) 
Context Analysis 
Context Analysis 

^ Major Slcill Deficiencies: CARD IB 

^ j (N = 64) 

Structural Analysis (Inflected Endings) 
Context Analysis 
Organizing (Sequencing) 
Predicting/Extending (Convergent Outcomes) 

Major Skill Deficiencies: CARD 2 
(N = 42) 

Structural Analysis (Syllabication) 
Remembering 

Predicting/Extending (Convergent Outcomes) 
Predicting/Extending (Convergent Outcomes) 

Major Skill Deficiencies: CARD 3 
" . (N = 4) 

Structural- Analysis (Syllabication) 
Context Analysis 

Organizing (Main Idea) -i ' ,V'. 

Remembering ^ '^V 

Remembering 

Locating ^ , 

Locating 

Predicting/Exte'nding (Convergent Outcomes) 



Items Missed 
N 



11 

8 
. 6 
9 



29 
22 
45 
22 



15 
14 
22 
22 



3 
1 



% 



85 
62 
46 
69 



45 
34 
70 
34 



36 
33 
52 
52 



25 
25 

100 
25 
25 
25 

'75 
25 



One hundred three (103) second grade students {89%) met or exceeded the 
objective. 



id > 

ERIC 
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28 



0 



GRADE THREE 



Pretest 



One hundred forty-one third grade students were pretested; 41 (29'0 took 
CARD Test lA, 55 (39%) took CARD Test IB, 27 (19%) took CARD T§st 2, and . j 
.'r* iS (-1-3%) took CARD Test 3. ; * 

. W'^ . ' * ' • Items Missed 

^Items ^ Skill T IE 

Major Skill Deficiencies: CARD lA 

5 ' Phonic Application/Initial Consonant (Substitution) 16 39 

12 Structural Analysis (Contractions) 19 46 

13 Context Analysis ' 16 ' 39 

14 Contei^t Analysis "22 54 

19 Context Analysis - 16 39 
'21 Locating Information , 17 41 

22 Remembering . ^ 26 '63 

— Major Skill Deficiencies: CARD IB 

(N = 55) . 

5 Phonic Application/Final Consonant (Substitution") 20 36 

7 Phonic Application/Medial Vowel (Substitution) 20 36 
11 Structural Analysis (Inflected Endings) 20 « 36 

20 Context Analysis - 21 38 

27 Organizing (Sequencing) 29 53 

28 Predicting/Extending (Convergent Outcomes) 23 42 

Major Skill Deficiencies: CARD 2 

(N = 27).: ■ . / 

5 Phonic^Appli cation/Medial Vowel (Substitution) 11 41 

8 Structural Analysis (Compound Words) 12 22 

24 Organizing (Sequencing) 10- 18 

25 Remembering 11 41 
) 27 Locating 11 .41 

28. Locating 10 18 

Predicting/Extending (Convergent Outcomes) 11 41 

Major Skill Deficiencies: CARD 3 
(N = 18) 



29 



14 Structural Analysis (syllabication) 9 50 

23 Organizing (Main Idea) 7 39 

30 Predicting/Extending (Convergent Outcomes) 6 33 



Posttest 



One hundred twenty-eight (128) srtudents were posttested; 10 [8%) took CARD 
Test lA, 18 (14%) took CARD Test IB, 16 (13%) took CARD Test 2, 60 (47%) 
took CARD Test 3, and 24 (18%) took CARD Test 4. * 



E£J£ . 29 39 



I tens^ Missed 

Items Skin Jj^ J_ 

Major Skin Deficiencies: CARD lA 
(N = 10) 

14 Context Analysis 6 60 

21 Locating Information " 4 40 

Major Skin Deficiencies: CARD IB' 
(H = 18) 

6 Phonic Application/Medial Vowel (Substitution)- , 6 33 

7 Pljonic Appn'cation/Hedial Vowel (Substitution^) 8 44 

11 Structural Analys'is (Inflected Endings) 6 33 
19 Context Analysi\.;^, ' 6 33 

22 Context Analysis'" • ■ 6 33 

26 Remembering 6 33 

27 ' Organizing -(Sequencing) 6 33 

28 Predicting/Extending (Convergent Outcomes) .. 14 77 

* Major Skill Deficiencies : CARD 2 

; , (N =16) 

5 Phonic Application/Medial Vowel (Substitution) 10- ' ' 63 

7 Phonic Application/Silent E (CVC-e) . 6 38 

12 Structural Analysis (SyllabitratKm];:-- -AQ -^—63^ 

14 Context Analysis- : - 6 ' 38^ 

24 Organizing (Sequencing) . 6 ^ 38 

25 Remembering ■ 6 ^ 38- 

29 Predicting/Extending (Convergent Outcomes) 6 v^^j :38; 



Major Skill Deficiencies: CARD 
(N = ^) 



2 Phonic Application/flWial Vowel (Substitution) , 14 ' 23 

3 Phonic Application/Medial Vowel (Substitution) 1-4 23 
14 Structural Analysis (Syllabication) : 20 33 

,23 Organl-zing (Main Idea) . 36 60 

*24 Remembering > ^ ^ ■ 30 ■ 50 

25 A Predicting/Extending (Convergent Outcomes) 28 47 

27 ( Vocating , 22 37 

28 ^ ■"'Locating-. ' ' ,. 18 . 30 

Major Skill Deficiencies: CARD 4 ■ / • 
(N = 24)' 

2 Context Analysis » 8 \33 

9 Structural Analysis (Syllabication) 16 66 

13 Organizing (Main Idea) ^8 33 

16 Remembering . J? , 

18 Locating 12 5tr 

20 Oraa{iizing (Sequencing) 10 42 

23 Organizing (Sequencing) -^^^ 8 33^, 



One hundred ten (110) or 85% of the third grade students met or exceeded 
the objective. 



ERIC i-N 



40^ 

30 



ERIC 




""1:7 



dWour 



Pretest 



One hundred eight (108) fourth grade students were pn€,tested; 15 (14%) took 
CARD Test lA, 40 (37%) took CARD Test IB, 42 (39%) toqik CARD Test 2, 11 {10%) 
took CARD Test 3. • f\ 



Items 



9 

10 
12 
14 
15 
20 
21 



,4 
5 
6 
8 
11 
20 
25 
'27 
28- 



5 
7 
8 
11 

l^ 

24 
25 
27 
28 
29 



3 
24 
27 
30 




Skin 



Major Skin Deftciencies: 
(N = ,15) 



CARD lA 



Structural Analysis (Inflected Endings) 

Structural Analysis (Inflected Endings) 

Structural Analysis (Contractions) 

Context Analysis 

Context Analysis » 

Context Analysis 

Locating Information 

Major Skill Deficiencies.: CARD 
zi ' (N = 40) 



IB 



•Phonic Application/Final Consonant (Substitlition) 
Phonic Application/Final Consonant (Substitution) 
Phonic Application/Medial Vowel (Substitution) 
Phonic Application/Medial Vowel (Substitution) 
Structural Analysis (Inflected £ndings) 
Context Analysis 
Locating Information 
Organizing (Sequencing) / 
Predicting/Extending (Convergent OutetJmes) 



Major Skill Deficiencies: 
, (N = 42) 



CARD 2 



Phonic Application/Medial Vowel (Substitution) 

Phonic Application/Silent E (CVC-e) 

Structural Analysis (Compound Words) ' 

Structural Analysis (Comparatives) 

Structural Analysis (Syllabication) 

Organizing (Sequencing) 

Remembering 

Locating 

Locating 

Predict! ng/Extend^ing (Convergent Outcomes,) 

Major skill Deficiencies: CARDS 
(N = 11) 

Phonic Application/Medial Vowel (Substitution) 

RefneAring . 

Locating 

Predicting/Extending (Convergent Outcomes) 



31 



41 



Items Missed 



N 


% 


9 


60 


8 


53 


5 


33 


7 


47 


6 


40 


6 


• 40 


8 


53 


20 


50 


19 


48 


17 


43 


14 


35 


19 


48 


15 


38 


19X^_48^ 




40- 


21 


50 


21 


50 


15 


36 


14 


. 33 


15 


36 


23 


55 


14 


33 


15 


36 


14 


33 


26 


62 


w 

5 


t 

45 


5 


45 


6 


55 


6 


55 



Posttest 



Ninety-six (96) fourth grade students were posttested; 2 (2%) took Card 
Test lA, 32 (33%) took Card Test IB, 26 (27%) took Card Test 2,' 24 (25%) 
took Card Test 3, and 12 (13%) took Card Test 4. 

Items Missed 

Items Skin • N 





Major Skin Deficiencies: CARD lA 




• 




(H = 2) 






9 ' 


Structural Analysis (Inflected' Endings) 


2 


100 




Major Skill Deficiencies: CARD IB 


- 






(N = 32) 






10 


Phonic Application/Medial Vowel (Substitution) 


10 


31 


11 


Structural Analysis (Inflected Endings) 


10 . 


31 


25 

Cm %/ 


!nraf*inn TrTfnrmal"! nn 


22 


69 


26 


Remembering > » 


12 


38 


27 


Organizing (Sequencing) • ' 


14 


44 


28 


Predicting/Extending (Convergent Outcomes.) 


16 


50 




Major Skill Deficiencies: CARD 2 








. (N = 26) 






5 


Phonic Application/Medial Vowel (Substitution) 


14 


54 


7 


Phonic Application/Silent E (CVC-e) 


8 


- 31 


20 


Context Analysis 


10 


38 


28, 


Locatipg 


14 


54 


29 


Predi cting/ Extendi ng (Convergent Outcomes) 


20 


: 77 




Major Skill Deficiencies: CAKD 3 








(N = 24) 


ft 





3 Phonic Applicatidn/Medial* Vowel (Substitution) 8 40 

14 , Structural Analysis (Syllabication) 12- 60 

21 Context Analyses & 40 

23 Organizing (Main Idea) 10 50 

24 Remembering ^ - 8 40"" 

25 Predicting/Extending (Convergent Outcomes) 10 50 
27, Locating ^. • 8 40 
30 Predicting/Extending (Convergent Outcomes )*' 16 80 

Major SkilV^Deficiencies: CARD 4 
_ (N = 12)^ 

10 Structural Analysis (Syllabication) 6 50 

".16' Remembering* 8 66- 

20 Organizing (Sequencing) 10 83 - 

23 Organizing (Sequencing) 8- 66 

Seventy-six percent of the fourth grade students met or exceeded the objecti 
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GRADE FIVE 



Pretest 



Forty-ei^ht (48) fifth grade students were pretestedi 2 (4%) took CARD Test lA, 
9 (19%) took CARD Tes.t IB, 17 (35%) took GARD Test 2, and 20 (42%) took CARD 
Test 3. These fifth grade students were all achieving two or more grade levels 
below actual grade placement. 



Items i Items 



- 43 

33 



Items MisseV 



Major Skill Deficiencies: CARD lA 
(N = 2) 

9 Structural Analysis (Inflected Endings) 1 50 

10 Structural Analysis (Inflected Endings) , '2 100 

11 Structural Analysis (Contractions) , ' . .. ' 1 50 

13 Context Analysis " 1 50 

14 Context Analysis 1 50 

22 Remembering 1 50 

Major Skill Deficiencies: CARD IB 
(N = 9) 

^5 Phonic Application/Fi nal Consonant (Substitution) 5 55 

8 Phonic Application/Medial Vowel (Substitution) 6 66 

20 . Context Analysis 5 55 

25 Locating Information 5 55 

27 Organizing (Sequencing) 6 66 

28 Predicting/Extending (Convergent Outcomes) -4 44 

Major Skill Deficiencies:* CARD 2 
^ - (N =17) 

5 , Phonic Application/Medial Vowel (Substitution) 8 47 

8 I Structural Analysis (Compound Words) 14 82 

13 I Structural Analysis (Syllabication) 6 35 

24 ! Organizing (Sequencing) 10 59 

25 I Remembering , 7 41 

29 [ Predicting/Extending (Convergent Outcomes) 10 " 59 

Major Skill Deficiencies: CARD 3 

(N =20) V 

2 ; Phonic Application/Medi'al Vowel (Substitution) 14 70 

3 Phonic Application/Medial Vowel (Substitution) 12 60 

23 Organizing (Main Idea) - 9 45 

24 Remembering 11 55 

30 Predicting/Extending (Convergent Outcomes) 12 . ' 60 



Posttest 

Thirty-two (32) fifth grade students were posttested; 2 (6%) took CARD Test 2, 
and 30 (945^) took CARD Test 4. 



Items 



Skill 



Major Skill Deficiencies: CARD 2 
(N= 2) 



7 Phonic Application/Silent E (CVC-e 
13 Structural Analysis (Syllabication 



Major Skill Deficiencies: CARD 
(N ^ 30) 

9 Structural Analysis (Syllabication) 
10 Structural Analysis (Syllabication) 
16 Remembering 

18 Locating 

19 Predicting/Extending (Convergent Outcomes) 

20 Organizing (Sec(D"encing) 

21 " Locating 

22 Predicting/Extending (Convergent Outcomes) 

23 Organizing (Sequencing) • ^ 



Items Missed 
N % 



14 
18 
16 
18 
14 
20 
10 

iO, 
20 



.50 
■ 50 



47 
60 
53 
60 
47 
67 
33 
33 
67 



Thirty (94%) of 32 fifth grade students met or exceeded the objective. 
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COMPOSITE SUMMARY 
62 (74%) of 84 first grade students met or exceeded the objective. 
103 (89%) of 123 second grade students met or exceeded the objective. 
110 (85%) of 128 third grade students met or exceeded the objective. 
73 (76%) of 96 fourth grade students met or exceeded the objective. 
30 (94%) of 32 fifth grade students met or exceeded the objective. 
Pretest grade equivalent mean score for 505 first, second, third, fourth, 
and fifth grade students was 1.0 as estimated from the students' instruc- 
tional levels using the fallowing criteria: 92 to 96% word recognition 
mastery, at least 60% comprehension, and minimum established fluency* 
Posttest grade equivalent mean score for 463 first, second, third, fourth, 
and fifth .grade stents was 2»8* This is a mean grade equivalent 
increase in achievement of 1.8. 
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The second part of objective one stated that eighty percent of 
the students would make one month's gain for each month of partici- 
pation in the program as measured by standardized achievement tests. 
The participating school districts used different standardized 
achievement tests; therefore, it wrfs necessary to analyze and present 
this data separately for the different tests. Also, both pre- and 
posttest scores were not available for all students; thus, conclus- 
ions based on this data should be made with caution. .Approximately^ 
one-third of the teachers initiated the program for the first time 
this year and were not able to get it fully operational until the 
second semester. 

Since the most common tests used were the SRA Assessment Survey 
and the Gates-MacGinitie Reading Test, the evaluators chose those 
students for which pre- and posttest scores were reported. The 
results are presented in Table VIII. As indicated in Table VIII, 
pre- and posttest scores v;ere available on 434 of the 682 target 
students. The average total grade equivalent gain ranged from .6 
by fourth. graders to 1.4 by the second grader^ who took the Gates- 
MacGinitie Test. The average number of months of participation 
between pre- and posttesting was 6.0 months. Thus, based on these 
scores, the target students made .an average monthly gain of 1.7 
months. Eighty percent, or 347, of all target students demonstrated 
one month or more gain for each month which they participated in the 
program.- Based on this data, it is concluded that the second par*t 
of the objective was satisfactorily achieved. ^ 
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TABLE VIII , •; 

THE GAINS IN READING DEMONSTRATED BY THE TARGET STUDENTS' PART I CI RATING 
IN THE TITLE I, ESEA PILOT^ROJECT AS INDICATED BY PRE/POSTTEST SCORES 
ON THE SRA ASSESSMENT SURVEY AND THE GATES-MacGINITIE READING TEST 



GRADE 



TOTAL NO. 
PARTICIPANTS 



AVERAGE 
PRETEST 
SCORES 



4 

AVERAGE 
POSTTEST 
SCORES 



5 

AVERAGE 
,JOTAL 
' GAIN 



6 

TOTAL * 
AVERAGE 
MONTHLY GAIN 



TOTAL NO. 

MEETING 
OBJECTIVES 



SRA ASSESSMENT SURVEY - GRADE LEVEL EQUIVALENT 



1 


73 


1.1 


1.8 


.7- 


.11 


54 


2 


79 


, 1.3 


2.5 


1.2 


.20 


65 


3 


50 


2.0 


2.9 


.9 


.15 


42 


4 


82 


2.5 


3.1 


.6 


.10 • • 


65 


5 


15 


3.3 


4.4 


1.1 


.18 


12 


6 


12 


3.9 


5.0 


1.1 


.18 


10 






GATES-MacGINITIE 


READING 


TEST - GRADE LEVEL EQUIVALENT 




2** 


24 


1.6 


3.0 


1.4 


.23 


21 


2*** 


24 


1.5 


2.8 


1.3 


.21 


19 


3** 


3& 


2*1' b». • 


3.2 


1.1 


.18 


29 


3*** 


37 


- ' 1.9' 


-3.1 


1.2 ■ 


.20 


30 



i 



TOTAL 434 347 



Average number of months of participation between pre- and posttesting was 
six months. " . « 



** Vocabulary 
*** Comprehension 
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B. Objective Two 

By May 30, 1975, the participating LEA's, with the assistance of 
the consultants, will have demonstrated effective ongoing program 
evaluation applying the'AMS model. Evidence that this objective 
has been achieved will include: 

1. The number and percentage of the target students plaqed and 
maintained at their proper instructional level. . » c ^ 

2. The degree of accuracy which ekdh teacher systematically records A 
each target student's reading errors and implements appropriate ^? 
instructional activities* ^ ^ 

3. Completed pupil record sheets^ pupil contracts, and individual 
records of progress maintained by the teachers and verified by 
the supervisors, principals, and consultants. 

To determine the level of effectiveness achieved in accomplishing 

objective two, the following evaluation procedures were employed: 

1. Self-Evaluation Checksheet ^ 

A copy of the checksheet is included in Attachment '^1s 
checksheet was administered to all participating teachers during , 
February, 1975, which was at ^approximately the midpoint of the 
schooj year. ^ ^ . , ^ 

2. Consultant Visits ' 

Each classroom teacher was visited at least twice during the 
year by one of the project consultants. At the conclusion of 
these visits, a monitoring report was completed and distributed 
to the administering district and to the contact person where 
the visit, was conducted. . 

3. Principal and Supervisor Visits 

Each principal in schools where participating teachers were 
located was urged to, perform monthly monitoring visits to deter- 
mine the extent that the teachers were implementing the procedures. 
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4, Feedback Questionnaire ^ 

A copy of the feedback questionnaire is included^in 
Attachment £• The feedback questionnaire was administered to 
each participating teacher during May, 1975, 

5. Criterion and Standardized Norm-Referenced Test 

The CARD Criterion Reading Test developed by ECS; tl)e; 
SRA Assessment Survey, and the Gates-MacGinitie Reading Test 
were administered to measure the le^el of gains achieved by 
► the target students. The findings have already been clted^ 
under objective one* 

The primary focus of objective two was to assess the level of 
effectiveness achieved in applying ongoing program evaluation to 
the reading program. Conclusions related to the four evaluation 
procedures cited above include: 

1. The self-evaluation checksheets were effective as a monitoring 
device. It yielded information concerning the status of the 
program as perceived by the participating teachers. There were 
only limited follow-up procedures applied to verify the accuracy 
of the information provided. The checksheet was probably more 
valuable as .an instructional procedure than it was in yielding 
evaluative data on v/hich decisions about the program could be 
made. 

2. The consultant visits were one of the most effective^ procedures 
used to actually evaluate the level of effectiveness being 
achieved. Monitoring reports indicated that in most cases the 
consultants actually performed, or observed the teacher performing, 
the appl ication. of the procedures for continuous diagnosis. 
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Individual student folders were- examined to determine if pupil 
record sheets and contracts were being maintained. Each teacher 
was 'interviewed to identify problems being encountered and 
progress made. ^ x 

Principal and supervisor visit? were a key to the leve\ of 
effectiveness achieved In 'this program. The level of effective- 
ness achieved appeared to be positively related to the leveT of 
involvement of the principals and supervisory staff at the district 
level. Only two districts actually used and recorded|fhe results 
of these visits as an evaluation procedure. Six of the nine 
districts had from minimal to excellent involvement wh^'^fe t|ie 
principal and/or supervisory staff's involvement was oj/t evident 

in three districts. Those principals and/or supervisors who 

f • 
regularly attended the in-service training activities in Little Rock 

were those most actively involved in the project in their ov/n 
school. Although actual records documenting the involvement of 
principals and supervisors wer^.lacking in all. dis|tricts, it was 
not difficult to conclude that this evaluation procedure is the 
most vital to be used •in evaluating the ohgoing level of accomplish- 
ments being achieved. The coordinators of federal programs were 
the key, to the total operation of the project v/ithin the school 
district. 

The feedback questionnaires were effective evaluation procedures 
which, when used with direct observation, verified evaluative data- 
collected. 

The CARD Criterion-Referenced Reading Test administered as a 
pre/posttest and as a continuous assessment of progres^^ proved to 
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be an effective measurement procedure* The effectiveness of 
these tests as evaluation instruments was dependent upon the 
teacher's accuracy and consistency in determining each student's 
highest instructional level in the basal series and maintaining 
this levef^as he overcame those skill deficits generated in the 
weekly^diagnosis. It was evident in some data generated by the 
criterion-referenced tests that some of the teachers either did not 
have the s^tudent properly placed at his instructional level, 
or they did not administer the proper criterion test corresponding 
to his placement. These problems may have been due to the inade- 
quacy of the direction given for administering^the criterion tests 
and/or the fact that criterion-referenced testing on a continuous- 
basis during the year is an unfamiliar procedure to teachers who 
are more familiar with a pre/posttest design using criterion tests% 
The standardized norm-referenced achievement tests were used to 
compliment the criterion measures. The SRA Assessment Survey and 
the Gates-NacGinitie Reading Test proved to be adequate for this 
purpose. ^ 

Based on the analysis of the data generated, it is concluded 
that an adequate evaluation of the project was achieved. Thus, 
objective two was satisfactorily achieved as stated in the project 
proposal. 

Objective Three 

At the end of each month, the supervisors and principals will have 
demonstrated effective supervision and monitoring procedures in the 
Title I, ESEA AMS project by: 

1. Conducting a minimum of one classroom visit, per month to each 
target classroom and recording the degree of accuracy of placing 
each target student at his proper instructional level and record- 
ing, systematically, the reading errors generated by the students. 
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2. Conducting a minimum of one group meeting per month with the 
participating teachers to identify and discuss problems being 
encountered and aUernativg)procedures to be employed. 

Evidence that this objective is being satisfactorily achieved will 
be completed monitoring reports submitted to the project consultants 
who will provide written recommendations to any problems presented. 

To determine the level of effectiveness, the principals and 
supervisors implemented a supervision and monitoring systen. The 
consultants collected monitoring reports, tnterviewed the principals 
during the on-site visits, and arranged two special meetings for prin 
cipals and supervisors <luri ng the training sessions in Little Rock. 
As already cited, it was readily evident that the level of involve- 
ment of the principals and supervisors l/as positively correlated 
with the degree of success achieved by the teachers in implementing 
the program. It did not appear that the direct involvement of the 
federal programs coordinator was a critical factor; however, the 
level of the principal's and supervisor's involvement appeared 'to 
be related to the coordinator's involvement in the .training sessions 
and his or her relationship to the principal and/or supervisor in 
the local district. Thus, the coordinator's role was vital, but in 
a different sense than/the principal's and supervisor's. 

A review of the data collected indicated that ji\e number of 
/ principals who regu/iarly completed reports of their monitoring 
visits^was limited to two districts. Evidence from on-site visits 
indicated that the number of visits made was much greater than those 
recorded on the reports. It is concluded that, based on documented 
data, the minimum of one classroom visit per month to each target 
classroom was not achieved at the desired level. This should not 
be interpreted as a failure on the part of the principals. It was 
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evident that in the overall effort, the importance of this 
of the project was adequately emphasized by the cq/isul tants; 
and the principals from several of th^e districts were not released 
to a4:tend the traipng sessions in Little Rock. ^ 
The project strategy included the plan for at least one group 
meeting to be. held monthly at the local school level. Four of the 
nine districts reported that this'par.^^^^of objective' three was . 
achieved. Three reported bimonthly meetings, and one district evi- 
dently did not conduct any local meetings. In this case, it mjiy have 



not been critical, since the participating teachers were located in r 
adjoinipg rooms in a small school district. \^ 
Objective Four 

By May 30, IQys'Nmiety percent .of the forty-six elementary reading 
teachers who participate in the AMS Title I, ESEA Cooperative Project 
will have applied the )^MS model to a reading program involving fifteen 
to thirty target studerts. Evidence that this objective has been 
accomplished will be indicated by eighty percent level of accuracy in: 

1. Placing each target student at his proper Instructional level. • 

2. Recording, systematically, the reading error's generated by the 
target students* 

3. Matching the errors generated with the appropriate performance 
objectives. 

4. Completing weekly pupil contracts.^ 

5. Performing continuous diagnosis. 

To determine the number and percent of the teachers who successfully 
applied the prescribed instructional^ procedures- to fifteen to thirty . 

students, the consultants utilized l^ie results of on-site visits, 

; "\ ' • c 

classroom monitoring by principals and supervisors, and each teacher's 
response on a feedback questionnaire. An analysis of this data 
resulted in the following conclusions: 
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L Placing Each Target Student at His Proper Instructional Level 
Evidence collected indicated that forty of the forty-six 
teachers were able to determine the appropriate instructional 
level of their garget students* This accounted for ninety-two 
percent of the target students being placed at their instructional 
level at some time during the school year* Further analysis 
indicated that only 52.7 percent of the students were maintained 
at their highest instructional level for the major portion of the 
project year. Since determining and maintaining each student at 
his highest instructional level in ternvs of word recognition, 
comprehension, and fluency arebasic to the implementation of thi^ 
-rnodeU it was a part of ^the evaluation design to identify some of 
the most critical problems encountered by the participating 
.teachers and try to plan appropriate strategies to help them over^ 
come these problems in the implementation process. The following 
points summarize th6 conclusions resulting from the evaluation 
data collected: /- — -""^ ^ 

a. The training for teachers new to the model should be presented • 
in segments with time and supportive help between sessions^ to 
allow them to apply the procedures learned. It was found t\\at 
the scope of content in the training sessions was too broa^^to^ 
encourage the necessary step-by-step implementation procedures., 
Some teachers hurriedly proceeded to organize and code materia^^s 
before they mastered the procedures for performing diagnosis [ 
and recording errors generated. 

b. Some teachers were reluctant to use the weekly readi-ng for 
diagnosis for moving the student along in the basal series. 
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They had traditicfhally depended upon the basal serifes 
teacher's guidfe which stresses that the mastery of aJJ 



skills in the workbooks and/or skill sheets which accompany 
the text are of utmost importance to success in reading^. 
Those teachers who continued to adhere to this philosophy 
were Uncible to effectively utilize the weekly reading for / 
diagnosis* The two main purposes for conducting the reading I 
for diagnosis weekly are to: (1) identify each student's 
highest instructional level in the basal series and (2) gener- 
ate reading errors which would indica:te specific skill deficits 
on which directed teaching and independent skill practice could 
be focused. The weekly reading for diagnosis is a futile 
exercise unless it is used to accomplish these two purposes. 
In other words, it was found that if this model were to be 
effectively implemented, "reading" must be regarded as the 
student's afiility to^apply word recognition skills, comprehend 
what he reads, and meet acceptable levels of fluency » and not 
be all-inclusive as it relates%to the skill materials which 
accompany the basal - series. Teachers found that some of the 
skill materials were at least ,one grade level more difficult 
than the reading in the basal series'. The findings m this 
year's project activities indicated that the skill materials 
are broader in scope than reading and should be considered 
separately in the instructional schedule. Treatment of this 
issue must be more thoroughly stressed in the training of 
teachers^ to apply ^he system^* 
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2. Recording^ 'Systematically, the Reading Err^s Generated by the 
Target Students / 

ft 

This was the second major procedural task, which was involved 
in the implementation of the model. Evaluative evidence indi- 
•<^cated that this was a difficult task for teachers to master. 
Some of the difficulty appeared to be due to the burden of precise 
recordkeeping which has not generally been a part of their training 
in teaching reading. Another problem related to the development 
of a simple checksheet to use (see copy in Attachment F). The con- 
sultants and teachers made changes in the checksheet to make it 
more practical and usable. These changes caused some confusion; 
however, the problems were solved before th'e end of the project 
year. According to xlata collected, the checksheets were regularly 
used by approximately eighty percent of the teachers with approxi- 
mately fifty-five percent of the target students. 

3. Matching the Errors Generated with the Appropriate Performance 
Objectives ~ [ '. 

This was found to be one of the most critical points in the 
instructional process. At l^ast~f1-f-ty perc-ent of tfje teachers had 
great difficulty In performing this task. This task requires 
that the teacher have extensive knowledge of specific reading 
skilU^which would enable them to readily recognize the relation- 
ship between the error generated and the specific skill needs. 
Again, there was evidence that the teachers recognized the peed 
for improving their skills in performing this task; and as the 
year progressed, they became more skilled. 
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4; Completing Weekly Pupil Contracts 

* A copy of the pupil contract is included in Attachment G. 
Forty of the forty-six ^teachers indicated that they used the 
contracts to Some extent ^during the year. Twenty-five used 
these regularly. 




5. Performing Continuous Diagnosis ' ^ " . 

The tas"k of performing continuous diagnosis, weekly was the 
means of monitoring the progress of the individual student. 
The problems identified have already been cited under item one^ 
above. ' 

Based on evaluation data collected, it is concluded .that objective 
four was not achieved as specified. Fifty-five percent of the teachers 
satisfactorily applied the |iodel rather than the^ninety percent as 
stated in the objective. 

Objective Five . , • 

After participating in the AMS Title Ij ESEA Coop^native Rroject, ♦ 
the forty-six elementary teacher's and their immediate supervisors 
will respond positively to the AMs moclel bei^ng* applied in' the class- 
room as measured by a seTjsntjc j^iff erential instrument cdnstructed 
by the project consultants. The' expected level of positive response 
will be a mean of at least 3.5 ort a five-point scale. ^ 

The level of positive.l^esponse to the project was determined 

by administering a feedback questionnaire during May, 1975. The 

participants were asked to indicate how they^^feilt about various 

aspects of the project by circling a number which mosx closely 

' * \^ ■ * 

corresponded to their feelings. The key\used was 1— very n^gatively^ 

2— negatively, 3— so-so, 4--posi tivfely, 5"Very ppsitively. A summary 

of their responses is, as fptlows :• ■ 
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' Mean 
Aspect of Project ' * Rating 



Number Responding: 42 

1. In-service sessions in Little Rock: 

: Overall *' 3.7 

• • Length of sessions . ' 3.8 

. Content included . 3.0 

. Activities included for participants 4.0 

. Number of sessions 3.9 

. Help provided .by consultants 4.4 

. Ideas gained from other participants . 4.8 

. Facilities, and motel accommodations 4.4 

2/ The AMS Reading Program: 

. Overall 3.9 

. Determining each student's instructional level ' 3.6 

. Recording errors generated at instructional level 3.8 

. Using individual contracts ^ 3.5 

. Performing direct teaching activities 4.1 

. Providing independent skill practice 4.3 

. Conducting weekly diagnosis ^ 4.1 

• Maintaining each student-at his/her instructional level 4.7 

. I want to continue the AMS procedures. 4.0 

. I would like to participate in the project during 1975-76 4.1 

As indicated, the mean ratings on each aspect of the project 

exceeded the expected mean response of 3.5. Therefore, objective 

five was satisfactorily achieved. 

Jhe participants wei^g^also asked to include comments about any 

aspect of the program. Excerpts from these are as follows: 

Regular classroom teachers do not have enough time to implement the 

program^ ^ 



The recordkeeping should be minimized to make ijt manageable. 

o , , 

Teachers need time to identify, develop, and code materials for 
their support sgstem. 

The first workshops should be at least one week in length* 

Teachers need more contact with other teachers who are implementing 
the program (informal Tap sessions, etc.). 

Too much infd-rm^tion was given at each session* We coizTd have digested 
k the material much better if we had moxe sessions and were given fewer 

steps at a time* 
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The recordkeeping is detrimental to my enthusiasm f6z^^ teaching^ It 
must be simplified. Vie kept the project records^ in addition to our 
own recordsm That^s too much. 



I didn*t like to spend so much time away from my students. 0 

I would like to continue in the program and feel strongly that it is 
a very thorough method of teaching reading. The management and record'- 
keeping system is actually what most teachers are striving for, but few 
are able to accomplish it without helpm 

I was very proud of the progress of all the target students. ^Seyeral 
students made more th^n one yearns gain, but one student evolved from 
the point of requiring constant encouragement when doing a simple task 
to the point of reading a story independently and completing the work 
on his contract. For him, this was a monumental gain., 

The AMS system has been helpful to me as a reading teacher mainly in 
two ways: (1) it has helped in the organization of materials so they 
are readily available when needed, and (2) it has helped me to manage 
my time for instrtictional activity. 

These indi\Aidual contracts grenejated ^ lot of interest. The pupils 
were eager to see whnt they were ''to do each day. We used these con^ 
tracts with all the students in the reading program. 

The more I perform a diagnosis, the easier it becomes for me to place 
a child at his proper instructional level; and it wakes teaching easier. 

One of my students , who 1 thought was the lowest, slowest one in the 
group, was really helped by the program. He completed ,1^ level, even 
though the rest of the class, who were much faster, only finished 1^ 
level. This helped work habits r attitude, ability to use word attack 
skill, andt even comprehension. 
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■ . ■ ■ 'A ■ . ■ 

VII. CONCLUSIONS AND RECOMMENDATIONS ' 

Based- on the evaluative data collected, it is concluded thaf^s 
project was a successful effort to demonstrate a reading program which 
is effective in improving reading skills. Jt also has those necessary 
elements to insure accountability at the clas^oom level. The follow- 
ing points should be considered as the^ program is continued: 

The model is -now ready for replication in other districts. These 

demonstration districts should be involved in assisting adopting 

districts in initiating the program. 

More responsibility for follow-up and implementation should be 
assumed by local staff including the principal. 

Teachers involved in implementing this program should not be expected 
to keep all of the records they have been keeping pl^us those designed 
for this program. 
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ATTACHMENT B 
LIST OF SKILLS IN SUPPORT SYSTEM 




PART I 
READING SUPPORT SYSTEM 

Reading Skills 

^ Lef t-to-Ri ght Di recti ona 1 i ty 
Visual Discrimination • ' ^ - 
Visual Memory 
Letter Names and Knowledge 
Auditory Discrimination 
Sound-to-Symbol Knowledge 
Blending (Consonant and Vowel Substi^tuti 
Controlled Phonic Application ; :^ 
Context: Analysis (Closure) 
Reading Vocabulary Development 
Structured Analysis iSkills 
Oral Reading for Diagnosis 
Predicting Outcomes and Extending Ideas 
Locating Information 
Remembering and Following Directions 
Organizing 

Evaluating Critically - 
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PROCESS AND PRODUCT EVALUATION DATA FORMS 
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. - > "XARO TEST (FORM A) ' • 

LIST OF SKILLS AND DUMBER OF TEST -ITEMS. AT EACH LEVEL 





AA 


BB 


CC 


lA 


IB 


1 


• 

3 


4 


5 


6 


READING READINESS '\ 












• 










Visual Discrimination (Shapes) , 

Visual Discrimination (Letters) 

Visual Discrimination (Words) 

Visual' Memory (Shapes )«, . 

Visual Memory ^Letters) j 

Visual riemory vworas; i 

Auditory Discrimination (Initial Position) 

Audi tory^ Discrimination irina i ros luion; 

Auditory Discrimination (Medial Position) 


5 
5 
5 

• 


* 

5 
5 


5 
c 

5 


• 


• 






< 




• 


TOTAL • V 




15 


15 ^ 
















WORD RECOGNITION . 














* 








i 

Phonic Analysis 






















Initial Consonant (Sound to Symbol) 
Final Consonant (Sound to Symbol) 
'^Initial Consonant Substitutjion (Phonic Application) 
final Consonant Substitution (Phonic Appllcatioh) / 
Medial Vowel Substitution (Phpnic Application) 
nvn-P Substitution (Phonic AoDlication) 


- 


4 

2 
2 


3 ' 
5 


1 

5 
1 


1 
7 
2 


4 






STRUCTURAL ANALYSIS - ' ' 










« 












Inflected Endings 
Contractions 
Compound Words' 

Syllabication^ . ' 

Affixes' 

Comoaratives 






• 


2 - 

2 
o 


2 
2 


2 
2 

2 


' 2 
2 
2 


1 
1 

^ 


2' 
2 


1 

8 


CprfTEXT ANALYSIS- 








6 


6 


9 


6-. 


6 


6 . 


5 


Comprehension . . * . 






















Locating Information 
Remembering 

Organizing (Main Idea, Sequencing, etc.) 
Predicting Outcomes-Extending Ideas 








1 
1 
1 
1 


1 
1 

I- 
1 


2 
2 
2 
2 


2 
2 

■1 

3. 


3 
2 

4 


4 
J 

3 ^. 


6 
2 

Q 

'2 


DICTIONARY ANALYSIS 










2 








2 




'.TOTAL 




24 


28 


30 


30 


25 


27 


.27- 
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ATTACHMENT E 

SELF- EVALUATION CHECKSHEET 
■ FEEDBACK QUESTIONNAIRE 



9 




'The degree to which I feel cx^mpetent and am applying the basic procedures are as follows: 
Circle the numbejc which descri2?es your lovel of application for each procedure* 
KEY: 0- Not at all l^-limited application 2-'Satisfactory application 

PROCEDURE . RATim - ^ . dOMMENT 

.' ' ♦ ' 

Administered IRI for initial ^ 0 1*2^ 

* placement* ' 

Pe^xforming reading for diagnosis 
at least weekly for each target 

student. 0 U 2 

Recording reading errors generated . ^ • ' 

each time reading for diagnosis is 

performed » • 0 12' 

Matching reading errors generated 

to appropriate support system as ' 0 12 

outlined in the teacher's guide. 

Completing and using individual 

contracts with teacher directed ^ > 

activities included prior to ^ 
independent skill practice. 0 12 

Completing and using individual 
contracts with independent skill 
practice designed to teach 
reading skills related to errors 

generated* ^ ^ t ^ 

Constructing, organizing, and 
coding teacher-made learning 

materials according to each support ^ 
a^ystem needed for my target students 0 12 * 

Identifying, organizing, and 
coding published materials aa- 
cording to each support system 

needed for my target students. 0 12, 

Administering and recordj^ng pre- 
*post criterion'^refprenced^ reading 

tests as each student progresses , . 

from pfie level tp anothet^ - 0 1, 2 ^ ^ ' 

' ' , 

If given an opportunity to cont;inue in thic 'project next year I would (check which) 
' want to participate 

' ' not want to participate. ^ ^ . 



COMMENTS: 



TEACmiR 
SCHOOL 



AMS TITLE I PILOT PROJECT 
SELF EVALUATION CIIECKSHEET 

DISTRICT 

DATE 



PJc-ase prSvide the following information to serve as documentation of your progress in impli 
menting the AMS Reading Program acpording to the training you liavc r^eo&xved. 



1. 
2. 

4. 

5. 
6\ 
7. 

8. 

9. 
10. 

11. 

12. 



Target Students: 



No, 



Grade Level (s) 



Black 



Whit;e 



Date you first participated in pilot project 



Number of minut/s of daily instruction provided to target group 

The days' when/instruction is provided are M TU W TH 



(Circle) 



The time of day my target group meets is from 



to 



Number for which initial placement has been accomplished and Recorded 

Number for which you are presently recording reading Errors generated 
as continuous diagnosis is performed 



The frequency of reading for diagnosis which you are now performing is 

(once weekly, twice weekly, etc.) ^ . ^ 

The number for which individual contracts a!re being completed and used daily 

The number for which you are providing daily teacher directed activities 
x:elated to skill needs : * ,¥ 



The number of students you are presently maintaining at their proper instructional 
level is ' ; : 



The approximate number of materials which you have id^ezitified, organized, and coded 
for the support system 



(A, B, - 0) 



No. of Materials 
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.MEMORANDUM - • ■ - 

TO: PiiotTeach^rjs DATE: April 28, 1975 

FROM: Fay W.Smith 

Educators Consul tfj^g ServKes^ lac. 

SUBJECT: ' Evaluation Data^tbrPflot Project 

Your assistance is needed to provide us with the information necessary to complete 
an end-of-year evaluation report. The following, information should help in getting 
this together. If you have questions, you may confer with one of us as we make our 
final visit. 

1. Complete the attached form Including the information for each of your target 
students. 

a. Initial placement refers to the book level, page, word recognition, com- 
prehension and rate at which you first placed the student at his instructional 
level. 

b. Exit placennent level refers to the book level, page, word recognition, com* 
prehensioa, and rate at his/her instructional level the last time you 
performed i diagnosis before completing this form. 

c. Standardized test scores (pre and post) should be recorded in grade level 
equival^lTt scores. In case this is impossible, include a note on the bottom 

of thefiage indicating if it is percentile, raw"score, etc. Be sure to indicate 
what test was used and dates of testing . If your particular test does not 
give vocabulary, comprehension, and total reading, record what you have 
and indicate how it is designated on the test printout. If you already have ^ 
this test data recor<^ed on another foVm, just attach it and don't bother to 
re-copy on this form, 

2. Complete the attached feedback questionnaire. Be a$ specific as you possibly 
can. Use back of page or extra ^sheets if the space provided is not adequate. 

K> ^ % * 

f 

3. Include a summary of how you involved parents or attach thd parent involvement 
form which was provided to you.al one of the meetings. 

* 4, Be. sure to administer any final criterion test to students who have completed 

or have almost'^ompleted a book level where the test manual indicate§ it should 
be administered. Record the results as you have been recording them and give 
them to your supervisor to send to^us. If youf'nfeed copies of particular tests, ^ 
ask your supervisor to find out hoyv many each teacher needs of each l^eveli and 

• • .we will get. them tb you immediately ' . 

,9^FWS:bjm ° 88 



EDUCATORS CONSULTING SERVICES, INC. 
P'. 0. Box 1503 
Conway, Arkansas, 72032 

DISTRICT " SCHOOL 

TEACHER • ^DATE [ - 



f lease complete the following questions for use (n evaluating the effectiveness of the 
AMS Pilot^'Reading Project in which yov participated during 197^-75. Give your own 
opinion and don't be timid about being either posifiv^ or negative about any aspect 
of the program. 

1. Date you first began participating in the Pilot Project: 

2. Number of target students you taught: 



3. Number of minutes of daily instruction in reading provided to target students: 



4. The days each week the reading instruction was provided to target students: 
(circle) M TU W . Tft F , 

5. Number of garget students you were able to accurately place at their instructional 

level and record the results: 

6. Number of target students for which you were able to conduct continuous diag- 
nosis during the spring semester of 1975; 

7. The frequency of reading for diagnosis which you were able to perform during 
the spring semester: (once weekly, twice^eekly, ofice each month, etc.) 

f — ■ - , ■ — 

( 

8. Th^ number of target students for which individual ^contrabts were completed and 
used daily during the spring semester: _____ 

9. The approximate number of materials which you have identified^ cbnstructed, and 
coded for the support system."^ (Show the number for ea^li letter separately.) 

Letter - • Numbel" of Materials 



. f 
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8^ 



10. Number of target students to which you administered appropriate criterion 
reading test: 

11. Number of target students you were able to maintain at thisMnfetructional level 
during the spring semester:^^, 

12. On the average, what was the frequency of group meetings involving the pilot 
teachers.in your district? {once monthly, twice, not at all, etc.) * 

13. How many of the in-servicfe training- sessions did you attend in Little Rock? 
(all, missed one, two, etc.) \ 

H. Please rate the extent you feel you were able (or unable) to perform each of the 
major steps in the procedures and add your comments about difficulties, satis- 
faction, etc. • RATING KEY: 1— not at all 5~excellent- 

Steps in Procedtares Circle Rating 

a. Perform diagnosis and accurately place '1 2 3 4 5 
each student at hl5/her proper instruc- 
tional level.. 

Comment 



b. Record errors generated on an 
Individual checksheet. 

Comment 



c. Match errors generated with 
: appropriate support system ~ 
A;fr:C/etc. 

♦ 

Comment 



d. Complete Individual contract which wSs 
used dally with, or by, the student. 



T --2 




4 5 



Comment 



e» Provide directed teaching of skills 
related to^r^^f^ generated. 

Comment 



1 2 3. a 5 



Pro>?'ide independent skill practice which 
related directly to teaching skills'con- / 
nected to reading errors generated. 

Comment ' 



1 -.a-rS — ~tr^ 5 
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g. Perform continuous diagnosis for each, 
student at least once per week. jjt 



Comment 



h. Maintain each student at appropriate 
Instructional level during the spring 
semester . 

Comment 



L Code and organize instructional 
materials according to the system. 



f 2 3 H S 



Comment 



15., Please indicate how you feel about the program by circling the number which 
most closely cprr'esponds to your feeling. Add comments at the bottom about 
.any item. 



KEY: 1 —very negatively; 2—negatively; 3 
5 — very positively ;/ 



-so-so; U^-positively; 



vThe ir>-service sessions held in Little Rock 

•^-^ Overall 

% 

Length of sessions 

— Content included 

— Activities Included for participants 

— Number of sessions 

— Help provided by the consultants 

* ~ Ideas gained from other participants 
~ Facilities and motel accommodations 
Comments (positive, negative, or suggestions) 



The AMS Reading Program 

— Overall 

— Determining each student's instructional 
level 

— Recording reading errors generated at/ 
instructional level ^/ 

— Using individual contracts 

— Performing direct teaching activities, 
— -""providing indep^dent skill practice 

, Conducting weekly di agnosis 



4 



~ Maintaining each student at his/her 1 
• Instructional level 

— I- want to continue the AMS procedures. *^ 1 

' — I would like to participate in the project 1 
during 1975-76. ' 

Comments (positive, negative, or suggestions) / 




16. Suggestions for 1975-76. What should be the emphasis for those involved 

during 1975-76? {Ipclude suggestions for new teachers as well as experienced.) 



17. Did you have any students which did especially well that you could share? 
^ ^ (describe briefly) . ' 




2 3 i» ' 5 
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SILENT 
RATE (WPM) 


DATE 


ORAL RATE 
(WPM) 
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ATTACHMENT G 
PUPIL CONTRACT 
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